Real-time detection and tracking of multiple objects with partial decoding in H.264/AVC bitstream domain

摘要

In this paper, we show that we can apply probabilistic spatiotemporalmacroblock filtering (PSMF) and partial decoding processes to effectivelydetect and track multiple objects in real time in H.264|AVC bitstreams withstationary background. Our contribution is that our method cannot only showfast processing time but also handle multiple moving objects that arearticulated, changing in size or internally have monotonous color, even thoughthey contain a chaotic set of non-homogeneous motion vectors inside. Inaddition, our partial decoding process for H.264|AVC bitstreams enables toimprove the accuracy of object trajectories and overcome long occlusion byusing extracted color information.